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ANY distributions of biological data present themselves as trun- 
| V cated, i. e., some of the observations in a sample are either below 
or above a limit which is inherent in the method of observation. The 
values beyond this limit are believed to form a continuation of the scale 
of measurement which is within the reach of the method of measurement. 
The problem of estimating the standard deviation and mean of the 
population from which the sample is taken is somewhat different from 
the problem solved by Pearson and Lee in dealing with incomplete dis- 
tributions where the method of sampling curtails the distribution at a 
certain point. In their case the proportion in the missing tail must also 
be estimated from the known tail. 

The present case is exemplified by the frequent event in experimental 
biology, that a known number, n, of individuals are exposed to some 
agent, and the responses of some of these, a, fall outside the truncation 
point. For instance: 20 animals are injected with the same dose of 
antigen, blood samples from each animal are tested for antibody after a 
certain time, but only 12 of these samples contain measurable amounts, 


* From the Department of Biostatistics, Harvard School of Public Health. 
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while 8 samples do not display any antibody with the given technic. 
It is reasonable to believe that these 8 animals have also responded to 
the antigen, but that the amount of antibody produced is too small to be 
demonstrated by the given method. 

If the mean response of these 20 animals should be compared to the 
mean of another group treated with a more potent antigen which is able 
to produce measurable antibodies in all individuals, it is important to 
estimate the mean and standard deviation in the truncated sample by a 
method for which the error of the estimates is known. 

Pearson and Lee could only utilize the information given by the 
recorded observation, the size of the whole group being unknown. In our 
case we can operate with both the measurements of the 12 individuals 
and the fact that 8 out of 20 animals have responded less than the point 
of truncation. 

It is suggested that the data be arranged in the following form: 
(1) The scale of measurement is translated so that the point of trunca- 
tion is zero. The measurements are then given in terms of 


where the wu; are the actual measurements or their transformation into 
normally distributed metameters, and r, is the point of truncation. 
ro will always be chosen on the basis of the biological theory or the 
praxis underlying the type of experiment; e.g., if an antibody cannot 
be measured in titers less than 2, the natural point of truncation is 2. 
(2) All observations in the truncated part are given the value 0, although 
it is believed that the theoretical values are less than 0. 

It will be convenient to consider first some of the mathematical 
relations which hold in the parent population. We assume first a normal 
distribution with mean » and unit variance, truncated at 0. We recall 
that the value 0 is assigned to all negative values of r. 

Then the fraction P below the truncation point is 


1 0 1 
P= —— -t#/2 
fe fe dt. (1) 


The truncated mean, p, is determined by 


1 1 
oa w)*/2dr + (2) 
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and introducing 


(2) becomes 
(4) 
A convenient parameter will be 
(5) 
for the difference between the truncated mean and the true mean. (Note 
that the sign of y is positive if the truncation is at the lower end of 
the distribution, negative if the truncation is at the upper end of the 
distribution. ) 
Relations (1) to (5) serve to express any of the variables P, p, p, 
and y in terms of any other. In Table 1, p is taken as the independent 


variable. 
Consider now the truncated variance, y, defined as 


1 
f (tp) (1) = re (rw (6) 


It is easy to show that 
1=Q— 
or 


If now we consider a parent population which is normal with mean 
m and variance o*, we have the following relations: 
P’ = P, 
p = po, (8) 
= 10", 
where the primed quantities refer to the distribution (m,o*), and the 
unprimed to the distribution m/s, 1). 
Further we have obviously 
=k, (9) 


say, a relation which will be useful later. It is clear that » and x may 
be expressed as functions of P or of the other variables. In Table 2, 
x is taken as the independent variable. 


1 
—— 3 
(3) 
1=Q—py. (7) 
| 
1 | 
) 
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TABLE 1 
Constants of a truncated normal distribution ; 
standard deviation known from outside sources 
3.0 2.99962 00135 000382 9998 
2.5 2.49817 00624 .00183 .9988 
2.0 1.99131 02322 .00869 9943 
1.9 1.88862 02947 .01138 9921 
1.8 1.78518 03712 01482 
1.7 1.68084 04640 01916 .9873 
1.6 1.57574 05758 02426 .9823 
15 1.46852 .07098 03148 9787 
1.4 1.35998 08692 04002 9727 
1.3 1.24934 10577 05066 9652 
1.2 1.13614 12795 .06386 9560 
1.1 1.01976 15392 08024 9446 
1.0 89947 10053 .9303 
9 77423 12577 9121 
8 64275 .2602 15725 8913 
7 50319 .19681 8645 
6 35293 3621 24707 8310 
50 .18810 4254 31190 
45 09826 4609 35174 
.00213 4992 39787 
35 — .10204 5406 45204 .7007 
.30 — .21651 5857 51651 6618 
25 — .34486 6349 59486 6160 
.20 — .49288 6890 69288 5609 
18 — .55969 .73969 5355 
16 — .63225 .7364 79225 5077 
14 —.71198 .7618 85198 4771 
12 — .8010 .7884 9210 4429 
10 — .9023 38166 1.0023 4044 
09 — .9592 8313 1.0492 3831 
.08 — 1.0213 8464 1.1013 3602 
07 — 1.0899 8621 1.1599 3353 
.06 — 1.1671 8784 1.2271 3085 
05 — 1.2556 8954 1.3056 .2782 ' 
04 — 1.3602 9131 1.4002 2444 
03 — 1.4897 93185 1.5197 .2058 
02 — 1.6631 95185 1.6831 -1600 
01 — 1.9384 97371 1.9484 1001 i 
005 —2.1920 98581 2.1970 .0623 


001 — 2.7178 99671 2.7188 0183 
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TABLE 2 
Constants of a truncated normal distribution ; 
standard deviation estimated from truncated distribution 
10 00079 3.1585 000216 .9985 1.8181 
15 00507 2.5743 001606 .9911 1.7391 
.20 .01378 2.2085 004836 .9755 1.6667 
30 -04050 1.7613 .01638 1.5384 
40 .07380 1.4810 03295 8774 9770 1.4286 
50 -10928 1.2830 .05270 8231 1.3333 
.60 14474 1.1336 07433 7710 9448 1.2500 
70 -17909 1.0158 09701 7224 9260 1.1764 
80 21182 9203 12018 6776 .9060 1.1111 
90 24272 -14347 -6366 8852 1.0526 
1.00 27177 7741 -16663 5992 8638 1.0000 
1.2 32451 6671 .21200 5341 8198 9091 
1.4 -37080 5853 -25557 4796 -7753 
1.6 Al1L52 5207 -29706 4338 -7692 
1.8 44750 4684 -33642 3949 
2.0 47947 A252 .37373 -3616 .6476 -6667 
2.1417 50000 -39894 -39894 -34085 .6198 
2.5 54549 3444 45869 2965 5544 5714 
3.0 59679 -2883 53338 -2494 4755 -5000 
4.0 67109 .2160 65892 3558 4000 
5.0 12223 1716 -76106 
6.0 -75955 -1417 -84657 -1205 .2178 .2857 
7.0 -78799 -1203 91978 -1013 1773 -2500 
8.0 81037 -1043 -98357 -0870 -1476 .2222 
9.0 82847 0919 1.04002 .0760 .2000 
10 84336 .0820 1.0904 06723 1818 
12 86652 .0673 1.1774 05429 0829 -1538 
14 88368 0568 1.2504 04524 0664 -1333 
16 -89690 1.3132 .03860 .0547 -1176 
18 .90747 0431 1.3685 -03351 -0460 -1053 
20 91596 .0384 1.4168 .02957 0396 .0952 
30 94244 .0246 1.6002 .01817 .0221 .0645 
40 95618 1.7260 01286 0148 .0488 
60 .97030 0115 1.8968 00791 .0084 .0328 
80 97752 2.0134 .00561 0057 0247 
100 98191 .0066 2.1014 00431 0042 0198 


500 99628 0011 2.6779 00065 
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Let the experiment provide a sample of n observations, of which a 
fall in the truncated portion, and are therefore scored 0. The procedure 
involves the computation of the sample mean and variance, 


= X(r)/n 


and 
s* = [3(r°?) — nF*]/(n—1) 


and of the ratio 


h = 8*/?*. 
The corresponding quantities from sample and population are then: 
Quantity Sample Population 
Fraction below r= 0 a/n P 
Mean r p’ = po 
Variance 1’ = no* 
Variance/ (mean)? h = s*/7* = n/p" 


The procedure of estimating the population parameters will then be 
to equate appropriate sample values to the corresponding population 
values. There are two cases to consider, depending on whether the 
population standard deviation is known or unknown. 


THE STANDARD DEVIATION IS KNOWN 


This situation is not uncommon in the field of bioassays. In cases 
of rectilinear reaction curves the standard deviation of the observations 
around the line is often found to be independent of the mean reaction 
throughout the range of measurement, and also so at the end of the 
reaction line where it approaches some limit due to the technic of meas- 
urement. Some of the groups in this end may be truncated, and the 
standard deviation can then be computed from the complete distributions 
and later applied to the truncated ones. It should be emphasized that 
the standard deviation should also be estimated from the truncated dis- 
tributions themselves and compared to those of the complete distributions, 
before the above assumption can be considered legitimate. 

The assumption of a known standard deviation will, as shown below, 
increase the weight of the mean of the truncated distribution con- 
siderably, so that this principle should be applied as far as possible. 
The principle is illustrated by the following example. 


Example 1. Various doses of tetanus toxin 2C were given intra- 
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venously to groups of 10 mice each (Ipsen, 1941, protocol 103).1 The 
death times for the mice (ranging from 17 to 146 hours) were trans- 
formed into normally distributed reaction metameters (y) which follow 
a function that contains the reciprocal of the death time, being 0 at 
“infinite” death time. Table 3 presents these transformed death times 


for each dose of toxin. 
TABLE 3 


Survival of mice following injection of tetanus towin 


= log(mg. of toxin) 
2.0 1.5 1.1 0.8 0.5 0.3 0.2 0.1 


> 1.93 1.93 1.44 0.86 0.79 0.40 0.31 0.19 
> 1.93 1.93 1.21 0.86 0.61 0.39 0.31 0.19 
> 1.93 1.63 1.21 0.86 0.61 0.29 0.22 0.12 
> 1.93 1.63 1.11 0.86 0.61 0.29 0.22 
> 1.93 1.44 1.11 0.86 0.49 0.22 0.22 
> 1.93 1.44 0.86 0.86 0.49 0.22 0.22 
> 1.93 1.44 0.86 0.86 0.46 0.22 0.15 

1.63 1.44 0.86 0.86 0.40 0.22 

1.63 1.44 0.86 0.70 0.31 0.15 

1.63 1.21 0.86 0.61 0.29 0.12 


Survivors 0 0 0 0 0 0 3 7 


The experiment was designed to show that the mean y for each dose 
has a rectilinear regression upon the log dose with regression coefficient 1 ; 
i.e, ¥==a-+-2. Accordingly the problem is to compute the mean y for 
each group and test the validity of the equation. The first and the last 
two groups are truncated. The latter two are truncated at 0.11, which 
corresponds to 150 hours, after which time there were still found sur- 
vivors in these groups. The first group is truncated in the “ upper end ” 
at 1.93, because 7 mice were found dead after 17 hours (y = 1.93). 
It means that they died unobserved during the first night, and since the 
function y varies widely in the first hours, it is safest to state that the 
mice died before 17 hours, instead of trying to assign some death time 
during the night. 

For reasons explained in the work from which the data are taken, 
we can assume that the variance of y is independent of the mean y. 
Thus, it is legitimate to utilize the estimate of o from the five com- 


*J. Ipsen, Contribution to the theory of biological standardization. Nyt 
Nordisk Forlag (Copenhagen), 1941. 256 pages. 


e 
n 
PS 
1s 
| 
he 
ns 
at 
is- 
1s, 
WwW, 
le. 
» 


8 JOHANNES IPSEN, JR. 


plete distributions for the calculation of the mean of three truncated 
distributions (see Table 4). 


TABLE 4 


Mean and variance of the five complete distributions 


g [y?] d. f. sy? x? P 
1.5 1.553 A7T761 9 .05307 17.53 2— 5% 
1.1 1.038 .38956 9 .04328 14.29 10—20% 
0.8 0.819 .07129 9 .00792 2.62 95—98% 
0.5 0.506 .21204 9 .02356 7.78 50—70% 
0.3 0.252 07576 9 .00842 2.78 95—98% 
1.22626 45 = .02725 


o=.165 Weight (gj) = 10/o* = 367 


TABLE 5 


Mean and weight of mean of the three truncated distributions 


Log dose 2.0 0.2 0.1 
Truncation 
point (r) 1.93 0.11 0.11 
r Tr r 
0 0.20 0.08 
0 0.20 0.08 
0 0.11 0.01 
0 0.11 0 
0 0.11 0 
0 0.11 0 
0 0.04 0 
— 0.30 0 0 
— 0.30 0 0 ; 
— 0.30 0 0 
S(r) — 0.90 0.88 0.17 
— 0.090 0.088 0.017 
t/o=p — 0.545 0.533 0.103 
— 0.283 0.291 0.990 
— 0.043 0.040 — 0.146 
g=mt+r, 1.887 0.150 — 0.036 ; ‘ 


Wig) 296 294 150 ‘ 
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There is some indication of heterogeneity as indicated by the P values 
of the x* test. Bartlett’s test for homogeneity gives a P value between 
1 and 2 per cent. 

The mean standard deviation is now applied for all the groups. 


The complete distributions will have an error of the mean equal to 
.165/Vn. The procedure applied to the truncated groups is illustrated 


in Table 5: (1) y is translated to r by subtraction of the truncation 
point; (2) the mean r is divided by o, which ratio is taken equal to p; 
(3) Table 1 is entered at p to obtain y; and (4) the mean, m, is com- 
puted as indicated and reconverted to 9, adding the truncation point. 
The weight of g is calculated as n/o*W(u), where the relative weight 
W(,) is found from Table 1 with p as argument. 

After the computation of all the 7 values and their weights, the test 
of goodness of fit to the presumed line #7 =a-+< is carried out by 
computing 

x? = = 7.851 


where a is (¥ —~), and 4 is the weighted mean of a. Since ,? is 7.85 
with 7 degrees of freedom, the fit is quite acceptable. 


THE STANDARD DEVIATION ESTIMATED FROM THE TRUNCATED 
DISTRIBUTION 


It frequently occurs that no assumption can be made as to independ- 
ence of variance and mean, or that all the distributions in the experiment 
are truncated. In such cases the standard deviation must be estimated 
from each truncated distribution. 


Example 2. The age distributions of poliomyelitis cases in cities, 
villages and country in Vermont, 1912-1925, are published by Aycock 
(1928) and the data are found in Table 6. 

With the given age grouping a heavy truncation takes place for fre- 
quencies under 5 years of age. In order to present the three distributions 
adjusted as normal truncated distributions, probit diagrams were made 
with the transformed values of relative frequencies plotted against 
various functions of the age values. 

It appeared that the logarithmic transformation gave rectilinear 
diagrams, and accordingly this particular function of the age was used 
as a metameter which was likely to be normally distributed. 

For the calculation of the mean and standard deviation the group 
value was assessed by the following steps, indicated in the first columns 
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of Table 6. The log age limits of each group were noted, and the mean 
of these limits assigned to the group. Then the truncation point 0.70 
(equal to log 5 years) was subtracted to normalize the scores into r. 
The truncated mean and variance were computed and their ratio, h, 
found. By means of Table 2 where fA is the argument, the quantities 7 


TABLE 6 


The age distribution of poliomyelitis cases in Vermont 1912-1925 
(From Aycock, example 2, Am. J. Hyg., 8, 35-54, Jan. 1928) 


TRUNCATION POINT 0.70 


Log Log Cases 

(age (group Cities Villages Country 
AGE limit) mean) fr Obs. Exp Obs. Exp. Obs. Exp. 
0-5 0.70 0.70 0 122 «#1155 104 = 100.5 99 83.2 


5-9 1.00 0.85 0.15 41 47.2 86 84.8 102 124.3 
10-14 1.18 1.09 0.39 15 17.2 30 40.6 73 76.9 
15-19 1.30 1.24 0.54 7.0 25 18.9 49 38.7 
20-24 1.40 1.35 0.65 3.8 7 10.9 19 22.7 
25-29 1.48 1.44 0.74 2.0 8 6.1 14 12.5 
30-34 1.54 1.51 0.81 1.0 4 3.3 12 6.7 
35-39 1.60 1.57 0.87 0.7 4 2.4 5 4.8 
40+ (1.80) 1.70 1.00 1.6 5 5.3 6 9.2 


196 196.0 273 272.8 379 379.0 


x* = 1.93 7.80 16.34 
d.f.=4 6 7 
.1221 .2208 .2981 
s?= .043353 .067881 .072331 
h = 2.92 1.39 17 
n= .2570 4823 
169552 .140745 104675 
Estimated population standard deviation =o= .412 375 324 
y= 2534 1132 
m = — .0927 -1258 
Estimated population mean = .6073 8358 9614 
Mean age = 4.05 years 6.70 years 9.15 years 
W(u) = 487 2061 3302 


and y were interpolated, and the variance of the whole distribution found 
as the ratio of s* to ». 

The expected number of cases per group was found by dividing the 
deviate of each log age limit from the mean by a, and the expected propor- 


BO 
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tion found in a table of the area and deviate of the normal distribution. 
The expected number of cases were then computed by multiplication of 
the proportions by N, the total number of cases. The x?-values indicate 
reasonably good fits of the distributions. 

As a test of significance of deviation of the means of the three series 
we computed 


x” = & (mean)*W(») — Woy [3 (mean) W () ]? = 64.05 


which is highly significant for 2 degrees of freedom. Thus, we can 
assume that the mean age for acquiring poliomyelitis in the particular 
case was increasing with decreasing density of population. 


THE VARIANCE OF THE ESTIMATES OF MEAN AND STANDARD 
DEVIATION 


The last columns of Tables 1 and 2 give the relative weight of the 
estimate of the mean in cases where the variance is known or unknown 
respectively. Reference has been made to these quantities in Examples 1 
and 2 without previous account of their derivation. 

The relative weights have been obtained partly by mathematical con- 
siderations and partly by experimental sampling. The case is simplest 
when the standard deviation is known, or can be assumed to have 
negligible error. 

The truncated mean 7 of the sample and the truncated mean of the 
population have both a variance equal to the truncated variance divided 
by n: 


V(#) =s?/n or V(p) =n/n. (10) 
Since m = 7—-yo, we may equate 
V(m) =0°V(n) + y°V (oe) (11) 
where the last term is negligible in the present case. From 
= V(e) [du/dp}? (12) 
and 


we obtain by insertion in (10) 


V(u) = (1/n) (n/Q?) (14) 


| 
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whence (11) becomes 
V(m) = (0°/n) (n/Q*) + ¥°V(e). (15) 


The factor Q?/n is the relative weight to be given to the mean of a 
truncated distribution in comparison to the mean of a complete distri- 
bution with the same n and variance. This factor is given in the last 
column of Table 1 as W(,). 

Equation (15) is now accepted as a working hypothesis in the case 
where the variance has to be estimated from the distribution itself, and 
where V(c) is an important quantity. 

We have equated s* to 7’ =o’, and accordingly it is assumed that 


=V(s)/». (16) 


In a complete distribution the estimate of the standard deviation has a 
variance approximately equal to s*/2n. In the truncated distribution 
which is becoming increasingly skew the larger the truncation is, it is 
logical that V(s) increases by a factor which is positively correlated 
with the degree of truncation. 

This factor was determined experimentally. A series of random 
distributions were truncated at various points, and the variance of the 
truncated mean and standard deviation and the mean and standard 
deviation were determined in a group of samples with the same degree 
of truncation. 


Experiments with random truncated distributions. Random numbers 
were transformed into probits, so that the theoretical population had 
mean 5.0 and unit variance. The probit values were grouped within 
ranges of 0.2 unit, partly to facilitate the computations and partly 
because most biological] data are given in grouped figures, and the experi- 
mental testing of the variance should be made similar to the conditions 
met in practical work. 

Twenty samples of the same size were randomized for each truncation 
point; the sample size varied from one truncation point to another, as it 
will appear from Tables 7 and 8. For each distribution 7, s, m and o 
were computed and the mean and standard deviation for each of these 
parameters were found for each of the groups. 


Truncated mean and standard deviation. The expected truncated 
mean is p and is found from Table 1, interpolating from the » column, 
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At truncation point 3.2, » thus is 5.0 — 3.2 = 1.8. By interpolation we 


find p= 1.8143. 
The expected truncated standard deviation is Wy, which is found 


from Table 2, interpolating from the p value. In the same way the 
expected value for h is found. 

As shown in Table 7, the expected values tally well with the observed 
* and s. The variance of * was expected to be equal to »/n, and the x? 
test shows that the observed values calculated from each group of experi- 
ments with 19 degrees of freedom do not vary significantly from the 
expectation. 

The variance of s was anticipated to be dependent upon »/2n, multi- 
plied by a factor which increased with increasing degree of truncation. 

The quantity («+ 1) fulfills these requirements, starting with 1, 
if the distribution is not truncated. 

Other possibilities were (1+ P) or 1/Q or powers thereof. The 
factor (x + 1) seems to fit better than any of the other quantities tested. 
In fact, it fits so well that the expected values of V(s) calculated as 


V(s) = (0%) (k + 1)/2n (17) 


do not deviate significantly at random or systematically from the observed 
experimental values of V(s). 

Since the experimental range is sufficiently large to cover the situa- 
tions met in practice, there is no need to search for a more complicated 
expression, although it is admitted that such a one could be found by 
complicated calculus. 


Variance of the mean and standard deviation of the whole distribution. 
The same set of experiments yielded observed values for the variance of 
m and o, the two final values sought. The variances and means are 
presented in Table 8. 

The observed means of m and o do not differ from the expected values 
(5.0 and 1.0, respectively) more than their calculated errors allow for, and 
there is no systematic deviation with increasing degree of truncation. 

The expected variance of the standard deviation can be derived from 
(16) and (17), which lead to 


(18) 


The expected values which are listed beside the observed values of V(c) 
in Table 8 do not deviate systematically or at random to such an extent 
that the hypothesis brought forward in equation (18) is contradicted. 
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For the expected values of V(») equation (15) is utilized with a 
substitution of the value of V(o) given by equation (18), so that we 
assume that 


n 1 


The variances calculated according to equation (19) were again 
compared to the variances estimated from the experiment, and also in 
this case no significant random or systematical deviation was found. 

Thus, it is established empirically that expressions for the variance 
of the standard deviation and mean, which were suggested on the basis 
of a few elementary assumptions, did cover the observed facts. The 
experimental range of the degree of truncation and the grouping of data 
in the experiments are of the order of magnitude which is reasonable to 
expect in most biological data for which this method is intended. 

The proposed method may not present the most exact solution of the 
problem, but it is not very complicated to use, and the above presentation 
demonstrates that it has no systematic error and the random error has 
been estimated satisfactorily. 

In order to facilitate the calculation of the relative weights of the 
estimates of the mean and standard deviation, the values of W() and 
W(o) are given in Table 2 for representative values of h. 


STATISTICAL METHODS FOR EVALUATION OF 
DIAGNOSTIC AND OTHER PROCEDURES * 
I. AN OBJECTIVE WEEDING-OUT PROCESS APPLICABLE 


TO MATERIAL USED IN SURVEYS OF 
DIAGNOSTIC VARIABILITY 


BY WILLIAM R. THOMPSON 


Division of Laboratories and Research 
New York State Department of Health, Albany 


INTRODUCTION 


HE question of reliability of prescribed technical procedures, such 

as diagnostic examinations by the same or different observers, pre- 
sents insistent problems of evaluation. One plan for a survey of varia- 
bility in diagnosis among independent observers of the same material is 
to obtain a generous unbiased sample from an appropriate source of such 
material, and have each observer render an opinion on each specimen. 
This was the plan in a recent study of diagnosis of tuberculosis from 
chest X-ray photographs by Birkelo, Chamberlain, Phelps, Schools, 
Zacks, and Yerushalmy (1). The same experience was used by Yeru- 
shalmy (2) and by Neyman (3) to illustrate certain forms of statistical 
analysis applicable to such data. 

However, we may be confronted by a dilemma in that we do not wish 
to spend great effort of all observers on certain kinds of material, such 
as that which would nearly always yield a negative diagnosis, yet we wish 
to have all observers examine other materials thoroughly. If we have 
some one select the latter material arbitrarily, no matter how skilled he 
may be, there is always a question as to how much such subjective influ- 
ences may affect the resultant estimates of variability in diagnosis. 
Indeed, it is doubtful that the results will have any precise meaning for 
anyone but the selector. 

As an alternative to this, it might be useful to have an objective 


* Presented at the meeting of the Society for the Study of Mass Medicine, New 
York, N. Y., May 18, 1948. 
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method designed to eliminate a considerable portion of the unwanted 
material in a manner that could be definitely recorded for any future 
reference. The present purpose is to describe such a method based on a 
system of direct probability sequential analysis that has been presented 
elsewhere (4), and to indicate how the consequently altered sampling 
conditions may be taken fully into account in analysis of the data. The 
intention is to suggest rather than to prescribe the manner of application. 


1. OBJECTIVE WEEDING-OUT PROCESS IN GOVERNING OBSERVATIONS 


Accordingly, suppose that in such a situation we have n reports on 
a given specimen, a of which affirm and b deny the specified diagnosis 
in question, and that all observers requested to do so either affirm or deny 
unequivocally on the basis of their independent judgments after thorough 
examination of the specimen (n=a-+b). Suppose that these observers 
may be considered as a random sample drawn from an infinite population 
of prospective independent observers of the same specimen (or essentially 
the same evidence in each instance), and that as the number of observa- 
tions n (one by each observer) is indefinitely increased, the ratio a/n 
may be expected to approximate an unknown value ¢, the true proba- 
bility of affirmative diagnosis for the hypothetical infinite population of 
observers with respect to the given specimen (or equivalent evidence). 
Then, for any number p not less than zero nor greater than unity, we 
should like to estimate P(¢ < p), the probability that ¢ is less than p 
in view of the evidence of the given n observations (a affirming and b 
denying). Although it is not ordinarily possible to evaluate P(¢ < p) 
precisely, it is possible by interpretation in terms of a problem previously 
solved (5) to obtain a best lower limit LZ, and a best upper limit H, to 
P(¢ <p) which are given by 


(1) L=I,(a+1,b) and H =I,(a,b +1) 


where the J-function is the Incomplete Beta-Function Ratio tabulated 
by Karl Pearson (6). Correspondingly, it can be shown that P(¢ > p) 
=1—P(¢< p) is bounded by L’=1—H and H’ =1—L where 


(2) L’=1,(b+1,a), H’=I,(b,a+1), and gq=1—>p. 


Thus we have L<P(¢<p) =H andl’ P(¢> p) =H’, as judged 
by the evidence of the n observations comprising a affirmations and b 
denials of the diagnosis in question; and P(¢ < p”) —P(¢< /’) 
= P(p' << p”), the probability that ¢ lies between p’ and p”. 
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In an obvious manner a weeding-out process may be based on such 
probability estimates with a specified maximum risk in each instance of 
inadvertent elimination of wanted material. Accordingly, after each 
observation on a given specimen we note whether or not it may be 
excluded from further observations with a risk not exceeding a prescribed 
tolerance T that we would be wrong in asserting that ¢ lies in some 
prescribed range or ranges. 


Example of a weeding-out system. In order to illustrate how such a 
scheme may operate, consider as an example that in a survey (possibly 
preliminary) we wish to avoid expenditure of great effort in examina- 
tions of specimens where ¢ should be expected to be low (i.e., where 
most diagnoses would be “negative”); and in precise terms we are 
ready to accept a risk not to exceed 0.05 that any given specimen so 
eliminated would have ¢ > 0.5. This means that we should set aside 
any specimen as soon as we find that P(¢> 0.5) = 0.05, i.e., if 
0.05 = H’ which equals Io;(b,a@-+ 1) in this case. Table 1 gives mq 
defined as the least value of n that permits such exclusion for a given 
value of a, i.e., the least nm such that Jo,(n—a,a+1)=0.05. The 
table lists corresponding values of LZ’ and H’, the best lower and upper 
bounds of P(¢ > p) for p= 0.75, 0.5, and 0.25. Of course, as the plan 
specifies, the values of H’ given in column six (where p—0.5) never 
exceed 0.05. Furthermore, the values of H’ given in the fourth column 
show that the risk is always less than 0.001 that we eliminate a specimen 
for which the true probability ¢ of affirmative diagnosis exceeds 0.75. 
The mounting values of L’ for P(¢ > 0.25) are interesting in that 
1— L’=> P(¢ < 0.25). Obviously, the probability is even less than 
that that a random specimen drawn from those remaining would have 
< 0.25. 

Of course, the tolerance 7 may be taken different from 0.05, perhaps 


higher in a preliminary survey than in a subsequent more extensive 
survey. Likewise, the critical value of p (taken as 0.5 above) may be 
chosen differently in accord with our purpose in a given situation. The 
principle here involved resembles that previously discussed (7,8) in pre- 
senting the notions of sequential analysis and associated apportionment. 
' Not only do we make successive examinations of the data as they are 


ou 


cbtained, but we use the evidence as it accumulates in order to avoid 

. - wasteful expenditure of experimental material (the case treated formerly 

) é (7,8) where the material may be human patients) or to avoid waste of 
the experimenter’s efforts as in the present case. 
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In our example weeding-out system suppose that we have 20 observers 
and start with 400 prepared vaginal smear slides, distributed at random, 
20 slides to each observer, who is given the name and address of his 
successor in a circuit of observation. Each of the twenty observers 
examines the slides sent him, passes them on, and reports the results to 
the office managing the experiment. There the data are scanned, and 
notices are sent to discontinue observations on any slide for which a 


TABLE 1 


Values of L’ and H’, respectively the best lower and upper bounds of the 
probability, P(¢>p), in view of the evidence of a affirmations and } denials of 
the diagnosis in question by n = a + b observers independently. The listed values 
of n, are the least n for the given value of a yielding a risk definitely not greater 
than 0.05 that ¢ exceed one-half, where ¢ is the unknown true probability of 
affirmative diagnosis. 


P(¢ > 0.75) P(¢ > 0.5) P(¢ > 0.25) 
a n, Ll’ H’ H’ H’ 
0 5 0.000 00 0.000 98 0.000 00 0.031 25 0.000 00 31 
1 8 000 01 ~=—.000 39 003 90 035 16 100 11 367 09 
2 11 000 00 = .000 13 005 85 032 72 197 09 455 21 
3 13 000 01 .000 13 O11 23 046 15 ~—-«.332 60 584 26 
4 16 000 00 = .000 04 010 63 038 41 404 98 630 19 
5 18 000 00 O15 44 048 13 518 66 717 46 
6 21 000 00 = .000 02 013 30 039 18 566 58 743 63 
8 26 00000 00001 01447 037 76 68515 55 
9 28 00000 00001 O17 84 04358 .75014 55 
10 30 00000 00001 .021 38 049 37 .803 40 .894 28 


affirmations have been made in the first na observations. In the follow- 
ing discussions we shall assume that further observations either are 
avoided by prompt action or excluded from the subsequent main analysis 
of data. If only half the specimens are eliminated after five observations 
and a total of 3/4 after 8 observations, this would save more than half 
(21/40) of the total work in an alternative “round-robin” experiment, 
if equal effort is expended on an examination of any such slide regard- 
less of resultant diagnosis. However, even more effort might be used in 
examining a “negative” specimen than otherwise; hence even greater 
savings might result. Moreover, much greater proportions might be 
eliminated in some cases. 


SEQUENTIAL SURVEY TECHNIQUE 21 


Some greater difficulty may be involved in statistical analysis of the 
results than in the case of round-robin surveys; likewise there would be 
a greater compromise of the issue resultant upon any losses of specimens 
after mn) and before all required observations had been made. Such 
difficulties should be weighed against possible advantages of a weeding- 
out process. Furthermore, we should consider the possibilities of bias 
of observers by knowledge that a weeding-out process is in use. To 
combat such tendencies, we may deliberately (with or without warning 
according to our purpose) leave among the specimens to be further 
examined some specimens taken at random from the excluded category. 
Obviously, such retention may be made in various ways, and in any case 
tendencies to bias may be considered part of the study. 

If, indeed, the judgment of observers is subject to considerable bias 
by any indication with regard to the relative frequency of “ positive 
specimens,” if an affirmative diagnosis is more likely in view of the 
same evidence when the observer believes on other grounds that affirma- 
tion should be more likely; then this alone suggests that the technic, at 
least as employed by the observers so influenced, does not meet minimum 
requirements for a trustworthy diagnostic method. It is obvious that 
evidence presented by the ordinary round-robin survey would not be 
enlightening in this regard; hence a weeding-out process might be 
recommended, even if for nothing else, to serve as a means of checking 
the usual assumption of unbiased, independent observation. This as- 
sumption is necessary to legitimate application of the usual methods of 
statistical analysis (2,3) and to those given in subsequent sections of 
the present article. Usually, a preliminary coaching and training of 
prospective observers is used to promote not only unbiased, independent 
diagnosis but also their employment as nearly as practicable of the same 
criteria (1,2). 

However, that fatigue may influence observation is well known. More- 
over, risks of this may be greater, the greater the dilution of “ positive ” 
with “negative ” specimens. An objective weeding-out process should 
aid in decreasing such influences, if thereby we obtain a wanted result 
with less effort spent on an undesirably great relative frequency of 
certain types of specimens. Good conditions of observation, including 
relief from fatigue, should be sought in any case, but their relative cost 
in round-robin surveys may be prohibitive. 

Of course, we should not overlook the possibilities of comparisons 
with other evidence from the same source as recently exploited by 
Isbell (9) in a study of correlation between vaginal smear and tissue 
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diagnosis in 1045 operated gynecologic cases. Such comparative material 
may be prepared even though it is not used in the first survey. Moreover, 
specimens discarded systematically in accord with the suggested pro- 
cedure may subsequently be examined further as the interest may appear. 

In the following sections of this article the problem of estimation of 
the character of the sampled population is considered. The relations in 
Section 2 are essential; Sections 3 and 4 present only one type of 
approach to the evaluation problem, but this is in close agreement with 
methods proposed by Neyman (3,10) as applicable to round-robin sur- 
veys. A relatively simple method applicable in either case is given in 
Section 5. It has the further advantage of avoiding any hypothesis 
about the population form. This is in accord with the fundamental 
notions previously developed (4,5) that have been applied in the 
weeding-out process itself. The arrangement of sections has been made 
to facilitate reading part of the article separately by those not imme- 
diately concerned with the estimation problem. 


2. PROBABILITY LINK BETWEEN WEEDING-OUT AND ROUND-ROBIN 
SYSTEMS 


Now, we shall try to avoid being unnecessarily or prematurely specific 
in any hypothesis about the sampled universe U, alternatively called the 
population of specimens. We assume that the character of U though 
unknown is fixed by the conditions of the scientific problem; perhaps 
the character may be described in terms of a certain set of undetermined 
parameters. In any case, let P’a,, denote the probability that a random 
specimen from the universe U will yield in n independent observations 
just a affirmations. Then /”,,, always has a definite meaning, and may 
be expressible in terms of undetermined parameters of U. However, it 
may be necessary or convenient to know the relation between 7”, and 
P,, the latter being defined as the probability that, under the operation 
of a given weeding-out process, just a affirmations will result. As above, 
it is assumed that any given specimen is drawn at random from U, and 
that the weeding-out process is defined by given fired values of nq for 
a=1,-:--,K, where K is the greatest possible value of n according to 
the weeding-out scheme. Let the cessation numbers (nq) be an increasing 
sequence for ah and let for a=h+1,---,K. 


Note: In the example weeding-out system used in illustration, we have n, = 5, 
n, = 8, n, = 11, n,» = 13, n, = 16, n, = 18, and n, = 20 fora >5. Here h=5, 
and K = 20. 
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Now, in general fo ™ without specification of the population JU, 
we can show how to evaluate the ratio Ra = Pa: P’an, for any specified 
weeding-out process. For convenience, we define 


(3) Pa: Pre 


Since there is no weeding out until after we have n=, obviously 


Pa = for hence =1. Of course (3) == 1, and there- 


fore C)=1. It is readily verified furthermore that Ca can be obtained 
from the recursion formulas: 


(4) C= for 0<a<h; and 
(5) tor a>h. 


In Table 2 are given values of C, and R, thus obtained for the 
example system. 


3. A MODIFIED FORM OF CHI-SQUARE FUNCTION (FOR FITTING 
PARAMETERS TO DATA) 


Without specification as to just what, if any, weeding-out system is 
to be used, consider certain general relations. Let N denote the total 
number of specimens in our random sample from U (the population of 
specimens). Let Na be the number of these for which we obtain just a 
affirmations in the prescribed number of observations (denoted by ng). 
In a round-robin system mq is constant; in a weeding-out process it may 
be made dependent upon a in a prescribed manner. As previously, let K 
denote the greatest value of mq. Then, of course, we have the identity 


K 
(6) No=N. 


Now, suppose that we have some hypothetical population U described 
in terms of a finite set of undetermined parameters (6;) to be evaluated 
in some prescribed manner so that U may be taken as an estimate of 
the specimen population U, and that Pa, is the corresponding estimate 
of P’an in terms of these undetermined parameters. Likewise let 
Ra: Pon, and We suppose that U is a possible 
description of U and hence that 


| 
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(7) > Pa=1, hence N=—N. 
a=0 
Now, let (Wa) be any set of non-negative real numbers such that 
K 
(8) > Wa. N, 
a=0 


hut temporarily not otherwise defined; and consider the expression, 


(9) 


In the special case where we take Wa = Na, we have the x? used by 


TABLE 2 


Evaluation of the ratio R, = P,: P’, ,,, independently of any hypothesis about 
the sampled universe; dependent solely upon the set of cessation numbers (n,), 


a non-decreasing sequence. 


0 5 1 1 1.000 000 
1 8 8 0.625 000 
2 ll 55 25 0.454 545 
3 13 286 130 0.454 545 
4 16 1 820 570 0.313 187 
5 18 8 568 2 916 0.340 336 
6 20 38 760 12 843 0.331 347 
7 20 77 520 53 569 0.691 035 
8 20 125 970 110 175 0.874 613 
9 20 167 960 158 670 0.944 689 
10 20 184 756 180 298 0.975 871 
ll 20 167 960 166 240 0.989 759 
12 20 125 970 125 455 0.995 912 
13 20 77 520 77 410 0.998 581 
14 20 38 760 38 745 0.999 613 
15 20 15 504 15 503 0.999 936 


3 


TY 


it 
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Neyman (3) to fit parameters of a given hypothesis to the data by mini- 
mizing G*. However, in that case we must stipulate that Na is nowhere 
zero (Na >< 0 for every a), else no solution is possible. We shall exclude 
the possibility that Pa = 0 for any a; hence, as U is a possible form of U, 
we have 


(10) for every 4. 


In order to avoid the difficulty, we may take Wa as a non-decreasing 
linear function of Ng, with W., having a fixed value w>0 when 
Na= 0. Then, with extension for the sake of generality in formulation 
to include the case w= 0, it is readily shown to be necessary and 
sufficient that 
(11) 


provided that N—(K+1)w20. 
Correspondingly let Gw» denote G of relation (9) with Wa, defined 
by (11). Then G,—y. Now, let g be defined by 


N-w 
Im N—w(K 
Obviously, for w > 0, we have g > 0 and 
_ 9. (Na—No)? 
w ao Natg 
Let G denote G, unless otherwise specified. Then we may write simply 


-Na+w 


(13) 


(Na — Na) 
N 
where 


Now, it may be convenient to let the index i, of our set (0:) of 
undetermined parameters of U, be defined as running from —u to v 
inclusive, i.e., i—=-—u,-::,v. Then the number of undetermined para- 
meters is u-+-v-+ 1. This may be convenient as seen in Section 4 below. 
If we are to evaluate these parameters by means of minimizing G*, then 
we must set the partial derivatives 0G?/00;—= 0 for every i. Thus, in 
(14) we obtain the relations: 

K Na—Ne 


(15) 0G? /00, 
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where by (7) we have 
K 
(16) =0. 


Accordingly, relation (15) may be simplified by use of (6), (7), and 
(16) to eliminate Na, N,, and @N,/00; for any one value of a, say a= 0. 


4. EVALUATION OF PARAMETERS OF A HYPOTHETICAL UNIVERSE 
(SAMPLED POPULATION) OF GIVEN CATEGORICAL FORM 


Suppose that for a certain finite set of values (pj), where 0S pj = 1 
and j=0,---,u, that P(@—p;) is not necessarily zero, but that for 
any p~ pj; for every j we have P(¢ = p) =0. Then, let 


(17) F_; =P(¢= pj) 


be the first u+ 1 of the undetermined parameters (6;), respectively, 
for i= —u,---,0. Let us suppose, however, that unity and zero are 
the first and last values of pj, i.e., po = 0 and p,y=—1. These are the 
most desirable values of ¢, of course, since all observers (no matter how 
many) are expected to agree on the diagnosis of specimens whose ¢ = 0 
or 1. Since it seems unlikely that we should want to postulate that 
P(¢=p) +0 unless p=0 or 1, let us suppose, to simplify the present 
discussion, that there are only these two values of (pj), i.e., po=0 
and p,=1, and accordingly u—1. Then, the parameters (F_;) 
consist of F_, P(@¢=—1) and P(¢=—0). 

Now, let the unit interval (0,1) be divided into a set of v suc- 
cessive touching intervals (Ji) of length Aj, i.e., 


(18) Ji= p's) and = — p's 


for i=1,---,v, where pin = p's, p's =0 and p”,—1. 

Then, let F; be the relative frequency in U of ¢ within J;, exclusive 
of the values (p;), namely 0 and 1. For simplicity we may consider p’; 
and p”; excluded also, since this would not affect the value of F; because 
we have stipulated that P(¢—p) =0 if p is not in the set (pj). 
Similarly let f(p)-dp denote the relative frequency of ¢ within the 
interval (p, p+ dp), which, of course, is in reference to the true uni- 
verse U. Correspondingly, let f( p) instead of f(p) apply to the hypo- 
thetical universe U with which we aim to approximate U. Again for 
simplicity, let us stipulate that 7(p) shall be constant within each of 
the specified intervals (J;), and define: 


fy 
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(19) fi=f(p) for p in Ji. 
Obviously, then 
v's a 
for i= 1,---,v, and 


(21) 
4=-1 


where F_, and F, are as previously defined. We have thus v + 2 para- 
meters (F’') which we propose to determine so as to minimize G?, which 
1 | we shall consider to be as defined in relations (14) to (16), i.e., with 
or w=—=1and G=—G,. The result may be represented as shown in a fac- 
titious illustration in Fig. 1, where rectangles on the intervals J; have 
areas proportional to F; and a triangle with one side on the vertical at pj; 
and apex on the abscissal axis has an area likewise proportional to F_; 


(where, of course, = 0 or 1). 
re 
he 
oO | ESTIMATION OF CHARACTER OF 
at SAMPLED UNIVERSE 
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5% 
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che 
a Use of a hypothetical universe of this sort permits a number of simpli- 
+ ' fications in the technical work of estimation of the parameters, and is in 
of | approximate accord with suggestions made by Neyman (3,10) in intro- 


ducing the model system he used in analysis of the data of Birkelo, 
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Chamberlain, Phelps, Zacks, and Yerushalmy (1,2). Neyman (3) 


pointed out that the model scheme was a simplification of the actual 


situation which might better be represented by a subdivision much finer 
than that which he used. ; 

A number of technical economies have been developed for application 
of the scheme at present suggested, but will not be detailed here. It should 
be emphasized that x? (which equals G@*,) may be used instead of G@*, 
as above, if we are willing to take the risk that no solution will result 
(which is an unfortunate necessary condition if any Ng is zero in the 
observed results). However, it would introduce some bias if we reject 
such experiences or resort to use of Gw» only in such an eventuality. 
Likewise, it should be noted that the weeding-out scheme of observation 
is a generalization including the round-robin scheme as a special case 
(where we take all ng = K, a constant). 


5. ALTERNATIVE ( NON-PARAMETRIC ) METHOD OF EVALUATION 


As mentioned previously, there is a relatively simple alternative 
method of estimating the cumulative distribution of ¢ in the population. 
This is non-parametric and free from any assumption about the form 
of the population distribution of ¢ except that the cumulative distribu- 
tion is continuous. Let Pr(¢ < p) denote this cumulative probability, 
the relative frequency of ¢ less than p in the universe U. We proceed 
to estimate its expected value Py (o <p) in view of the evidence of our 
experience with N specimens, N, of which yielded a affirmations in ng 
observations (as prescribed for a= 0,1,---,K), the round-robin sys- 
tem being a special case wherein ng = K for every a. 

Now, for any given value of a, we can by relation (1) obtain best 
lower and upper bounds to P(¢ < p) for each of the Ny specimens in 
that category; i.e., 


(22) SP(¢ < p) +1) 


since b=n,.—a in this case. Furthermore, the probability that a 
random specimen from our sample experience of N specimens will be 
one of these is just N./N. Accordingly, we can obtain best lower and 
upper bounds, LZ, and H,, for the expected probability that a random 
specimen from the N under observation would have a value of ¢ less 
than a given p. Obviously, these are given by 


ow 


ar 
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(23) (1/N)- +1, me—a), and 


These values may likewise be taken as best lower and upper bounds to 
the expected cumulative distribution Py(¢< p) for the universe U. 
Much less computational difficulty is encountered than in any chi-square 
solution (as in Sections 3 and 4), and there is no added assumption 
involved with regard to a hypothetical population U. The bounds may 
be far apart where there is considerable influence by small values of n. 
However, the main purpose of a weeding-out process is to decrease such 
influences in the regions regarded by the investigators as most important 
to their purposes, accomplishing this with due attention to economy. 
It may be convenient to define a mid-expectation estimate of Pu(¢ < p) 
as (Lp + Hy)/2. 

An example is appended to illustrate the evaluation and relative 
economy with artificial data, taken roughly to represent a situation such 
as might have been encountered in an actual experience like that of 
Birkelo and associates (1) but with a greater number of observers 
available—contrasting the results obtained with round-robin and 
weeding-out processes. 


Note: It is noteworthy that the Bayes-rule estimate of P(¢@< p) for a speci- 
men with a affirmations in n, observations would be I, (a + 1,n,—a+1). This 
is readily seen, from previously developed recursion formulas (11,8) for the 
incomplete beta-function ratio, to be related to our best lower and upper bounds 
by the identity: 


(25) 1,(a+1,n—a+1) = (1—p)-1,(a + 1,n—a) + p-1,(a,n—a +1). 


Accordingly, since the coefficients of the J-function values here are independent 
of a and n, we could obtain a Bayes-rule estimate of Pyl(? <p) by 


K 

(26) B,= (VN) -3N,-1,(a+ 1,n,—a +1), whence 
a=0 

(27) (l—p)-L,+p-H,,. 


6. EXAMPLES OF NON-PARAMETRIC ESTIMATION OF CUMULATIVE FRE- 
QUENCY DISTRIBUTION OF ¢ IN ROUND-ROBIN AND WEEDING-OUT SURVEYS 


As an illustration consider the partly artificial data in Table 3: 
I. A simulated round-robin experience of 20 observations on each of 
1256 specimens. II. A part of experience 1 obtained by taking note 


P 
1 
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TABLE 3 


Illustrative data, partly artificial, from a round-robin simulated experience 
I with n, = K = 20 and from a corresponding weeding-out experience II with n, 
as given; III is an actual experience in diagnosis of tuberculosis with large 
celluloid x-ray photographs(*) with n, = 5 throughout. 


I II III 

a N, ny N, n, 
0 994 20 1101 5 1125 5 
1 93 46 8 47 
2 45 13 ll 23 
3 14 9 13 17 
4 10 sis 2 16 17 
5 9 0 18 27 
6 7 ” 3 20 
7 4 3 
8 6 “ 6 
9 7 7 

10 5 “ 4 “ 

ll 3 “ 3 “ 

12 4 4 

13 5 “ 5 “ 

14 6 6 

15 9 9 

16 5 5 

17 3 “ 3 “ 

18 3 “ 3 “ 

19 3 “ 3 “ 

20 21 21 


Note: II was obtained from the artificial data of I by the weeding-out pro- 
cess. However, III was not so obtained but was an actual experience 
with n = 5 throughout. The total “ observations ” made were 4 times 
as many in I as in III, but only slightly more than 25 per cent more 
observations were required for II than for III. As previously, a is 
the number of affirmations in n, observations and N, is the number 
of specimens in the corresponding category. 


as to which specimens had no affirmations in the first five observations, 
one affirmation in five but no more in eight observations, etc., to yield 
the data for a corresponding weeding-out process employing the values 
of nz given in Table 2. Thus from the supposed round-robin experience 


| 


we 
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I in Table 3, the weeding-out experience II was obtained. III. An actual 
experience of Birkelo, et al. (1) with a round-robin of 5 observations 
on each specimen. 


TABLE 4 


Evaluation of L, and H,, best lower and upper bounds to P,(¢ <p), from the 
data of I, II and III, respectively, from Table 3 


I II III 
P Ly H, L, H, Ly H, 
0.01 0.1454 0.8055 0.0431 0.8795 0.0439 0.8976 
.02 .2678 .0846 .8823 .0862 .8994 
.03 3707 .8297 .1247 .8850 .1269 -9011 
.05 5302 .8494 -2006 .8902 -2035 
10 -7537 .8832 .3700 -9126 
.20 .8912 9157 .6140 .9192 -9266 
.30 .9228 .9307 .7710 -7663 .9381 
.40 .9359 .9409 .8647 -8580 -9480 
50 .9168 .9496 -9568 
.60 9574 -9442 9575 .9388 
.80 .9704 .9745 9701 9811 
.90 .9825 .9780 .9825 -9900 
.9809 .9884 .9809 .9884 9751 -9948 
97 .9818 .9920 .9920 -9968 
.98 .9823 .9823 .9943 9771 .9979 
.99 .9828 .9969 .9828 .9989 


In Table 4 are given the corresponding estimates of L, and H, for 
I, Il, and III with p0.01, 0.02, 0.03, 0.05, 0.1, 0.2,- - -0.9, 0.95, 
0.97, 0.98, and 0.99. These were computed with the aid of Karl Pear- 
son’s tables (6) and relations (23) and (24). The results are shown 
graphically in Figs. 2 and 3. 

What forms of presentation and analysis of results should be used 
will largely depend on the interest of the investigators and economic 
factors. The main purpose here is not to indicate preferred forms of 
analysis but rather to point the way to economical means of obtaining 
the data pertinent to a given investigation. Perhaps it would be ade- 
quate in some situations merely to exhibit the results as in Table 3, 
where it should be noted that the added information in the weeding-out 
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Best Uprer AND LOWER BOUNDS, L, AND H,, FOR THE EXPECTED RELATIVE 
FREQUENCY OF ENCOUNTERING IN THE POPULATION A SPECIMEN WHOSE ¢ ( PROB- 


ABILITY OF AFFIRMATIVE DIAGNOSIS)IS Less THAN A GIVEN p. 


I is according to the artificial data of a round-robin of 20 observations on 
each specimen; II, according to the corresponding data obtained in a weeding-out 
process (mean number of observations about 6.26); III is according to a round- 


robin of 5 observations (shown in Fig. 3). 
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L, AnD H,, For III. 
(Compare with I and II in Fig. 2) 
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survey II is obtained by an increase of about 25 per cent in the number 
of observations required for a round-robin survey with n = 5 as in ITI. 
Of course, there is no restriction to use of the form of weeding-out 
process used in illustration. If we can use more than 20 observers, then 
one recourse is to have mq as in Table 1 for 30 observers (K = 30) or 
more. Relative economy in obtaining such additional information would 
be even greater than in the illustrative example. From some practical 
points of view it might be more appropriate to judge the variability 
of a diagnostic method or other technic as in actual usage by many 
observers rather than by a selected few. Moreover, with the suggested 
scheme there would always be less work expected per observer the greater 
their number. 


Practical needs thus far unsatisfied in statistical methods for evaluation of 
diagnostic procedures were discussed at a conference with Dr. Gilbert Dalldorf, 
Dr. John K. Miller, and Dr. Victor N. Tompkins. The author wishes to acknowl- 
edge their contribution to the basic principles on which the present suggestions 
rest. 
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THE EFFECT OF THE CHANGE IN MORTALITY 
CONDITIONS IN AN AGE GROUP ON THE 
EXPECTATION OF LIFE AT BIRTH 


BY C. CHANDRA SEKAR * 
Population Division, United Nations, Lake Success 


INTRODUCTION 


HEN life tables are prepared periodically it becomes a matter of 

interest to know the extent to which the expectation of life at 
birth has been influenced by the changes in the mortality conditions in 
the different age groups. For instance, the rather frequent experience 
of a simultaneous increase in the expectation of life at birth and the 
marked diminution in the infant mortality rate, raises the important 
question as to what contribution the reduction in the infant mortality 
rate has made on the expectation of life at birth. Similarly the effect 
on the expectation of life of the improvement in mortality conditions 
which might have been observed in a particular age group as a result of 
specialised public health measures, is not without interest. In contexts 
such as these the expressions, “the effect of,” “the influence of,” or 
“the contribution made by” the change in mortality conditions are used 
synonymously. But what exactly is connoted by these expressions requires 
some consideration. In this article the difficulties that arise in giving 
a single definition to what is implied by these terms will first be pointed 
out, and will be followed by a discussion of the formulae and methods to 
evaluate the “effect,” using different definitions. Attention will be 
mainly confined to working out the “effect” of the change in mortality 
conditions in an age group on the expectation of life at birth. By a logical 
extension of this work the “ effect ” of the change in mortality conditions 
of two or more age groups on the expectation of life at birth or at other 
ages could be found. ; 


*On leave from the All-India Institute of Hygiene and Public Health. 
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TWO CONCEPTS OF “ EFFECT” 


If e) is the expectation of life at birth in the first period and e’, the 
expectation of life at birth in the second period, the effect of the change 
during this period in mortality conditions in an age group on the ex- 
pectation of life at birth may be conceived in the following two ways: 


(1) The difference between e, and the expectation of life at birth 
€ova (say) which would have resulted if the mortality conditions had 
changed only in the age group under consideration to the extent that it 
had, and the mortality conditions in the other age groups had remained 
unchanged. For uniformity, the effect may be considered as e9/a— @. 

(2) The difference between e’) and the expectation of life at birth 
e’ova (say) which would have resulted if the mortality conditions had 
remained unchanged in the age group under consideration, and the mor- 
tality conditions in all the other age. groups had changed to the extent 
they had. For uniformity, the effect may be considered as e’5 — e’o/a. 

The effect as obtained from the first consideration may be defined as 
the “main é¢ffect” and that obtained from the second as the “ operative 
effect.” The above concepts of the “ main effect ” and “ operative effect ” 
are capable of obvious extension when the influence of the change in 
mortality conditions of two or more age groups on the expectation of 
life at birth or at any other age is being considered. 


RELATIONSHIP BETWEEN MAIN EFFECT AND OPERATIVE EFFECT 


Notation: 
In this section and all through this paper the following notation will 
be maintained: 


és = expectation of life at x completed years of age in the first period, 
1, = number of survivors at x completed years of age in the first period, 
e’, = expectation of life at z completed years of age in the second period, 
l’, = number of survivors at 2 completed years of age in the second period 


l, =I’, — radix of the life table. 


Age span divided into two age groups 


The relationship between main effect and operative effect can be 
readily seen by dividing the age span 0 to w years (say) into the two 


MORTALITY AND EXPECTATION OF LIFE 37 


groups 0 to x years and z to w years and working out the effects* for 
the two age groups. 


Main effect. The change in the mortality conditions in the 0 to z age 
group will lead to a difference in the “number of years lived” between 
0 to x years of 


—Vre’2) — (loeo — lee), (1) 
and between 2 to w years of 
(V2 — Iz) ee. (2) 
The main effect of the 0 to x age group is therefore equal to 
(1/lo) { — — leer) + — Iz) ec}. (3) 
The main effect of the age group z to w years is 


The sum of the two main effects differs from the difference of the 
expectation of life in the two periods, viz. ) by 


(1/lo) — le) — ee). (5) 


Apart from J, this expression is made up of two other factors, one, 
(',—1.), representing the difference in the number of survivors at 
age z caused by mortality changes in the age groups 0 to z years and 
the other, (e's — ez), the difference in the expectation of life at age x 
caused by mortality changes in the age group x to w years. 

Whereas each of the main effects is solely due to the change in the 
mortality conditions in the age group to which it has reference, and 
vanishes if the mortality condition in that age group remains unchanged, 
the above expression is influenced by the change in the mortality con- 
ditions in either age group and vanishes if the mortality conditions in 
either of the age groups remain unchanged. 

The influence of the “interaction” is ignored when only the “main 
effects” are taken into account. 


In calculating these effects, use will be made constantly of the concept of the 
number of years lived after age # and its relationship to expectation of life at 
age @ given by, 

f li 
expectation of life at age of care 


number of survivors at age x 


~ 
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Operative effect. If the mortality conditions had remained unchanged 
in the 0 to x year group (and changed in the xz to w age group to the 
extent it had), the “ number of years lived” between 0 to x years, viz. 
l',e’o —U'ze’2 as given by the second life table, would have been (eo 
—l,e,). Also the “number of years lived” between x and w years 
would be l,e’, instead of I’ze’2. 


The operative effect of 0 to x years is therefore 
(1/lo) { — (lo@o — (6) 

The operative effect of z to w years is equal to 
(U'2/lo) (e's — ez). (7) 


The operative effect of the 0 to x age group differs from the main 
effect of that age group by (1/l,)(l’s —lz)(e’2 — ez), which, as noticed 
earlier, is the “interaction” of the two age groups 0 to x and x to w 
years. Similarly the operative effect of the age group x to w years 
differs from the main effect of that age group by an amount equal to 
the same interaction. It is therefore seen that whereas the main effect 
ignores the effect of interaction, each of the “ operative effects ” takes it 
into account. For this reason, whereas the sum of the two main effects 
falls short of the difference in the expectation of life in the two periods 
by an amount equal to the interaction, the sum of the two operative 
effects exceeds the difference in the expectation of life by an amount 
equal to the interaction. 


Age span divided into three or more groups 


The concept of interaction introduced above in the case when the 
age span was divided into two age groups is capable of extension. When 
the age span is divided into three or more age groups and when so 
generalised, the interaction can be shown to be the factor producing the 
difference between the main effect and operative effect. The definition 
of interaction when more than two age groups are involved, and the 
nature of the mathematical relationship by which the interactions relate 
the main effect and operative effect, are considered below with reference 


to the case of three age groups. 


Interaction generalised. Consider the age span 0 to w years divided 
into the three age groups 0 to z, zr tor+nandz+7n tow. 
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Let M,, M2, M; denote respectively the main effects over the three 
age groups, 
M,2, the main effect over the age groups 0 to z and z tox+n, 
M.,;, the main effect over the age groups to +n and z+ n to w, 
M,;, the main effect over the age groups 0 to z and +n to w, and 


M25, the main effect over the three age groups 0 to z, z to r+ n and 
x-+n to w years, 


The difference between the sum of the main effects over each of the 
two age groups and the main effect over the two age groups taken 
together, will be defined as the first order interaction. Denoting by 
I,2, I23 and J,, the three first order interactions possible in this instance, 
they are, by definition, given by 


= M,, — M,— 
= — Mz — M, (8) 
= — M, — M3. 


The second order interaction will be defined as the difference between 
the main effect over the three age groups and the sum of the three main 
effects over each of the age groups plus the three first order interactions 
each taken over two of the three age groups. If J,23 defines the only 
second order interaction possible in this case, 


= Miss — M, — (9) 


It will be observed that “interactions” as defined above? are but 
logical extensions of the basic concept introduced in the case of two age 
groups. It can also be shown that the first and second order interactions 
do, as their titles imply, measure influences resulting from the changes 
in mortality conditions of two and three age groups respectively, and 
vanish if the mortality conditions in any one of these age groups remain 


* Those familiar with the set-up of factorial experiments in modern statistical 
designs, and the techniques of the analysis of variance for interpretation of data, 
will observe the analogy between the relationship of main effects and interactions 
introduced therein and in the present discussion. The case of three age groups 
is very similar to a 2 X 2 X 2 factorial design. See Fisher, R. A., The Design of 
Experiments. Oliver and Boyd (London). 
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unchanged. For instance, in the example under discussion the various 
main effects are as follows: 


M, = (1/lo) (lo/U'o) [Vo(e’o — — ex) 
Mz = (1/lo) [V'e(e’s — ez) — Caen) 
Mz = (1/lo) [Vern (€’24n — Cxsn) J 

My2 = (1/Io) (lo/U’o) — €0) — xen) (10) 
= (1/lo) [V2 (e's — ez) 


— Cxsn) | 


Applying (8) and (9) to obtain the values of the interactions, 


= (1/0) — [Ve (e's — —V ain — | 
= (1/10) — 21m — Cxen) 
Tis = (1/lo) lesn[ (U2/le) — 1] — 

= (1/lo)(le — — — Caen) 


The formulae for the interactions demonstrate clearly that they do 
measure contributions to the change in the expectation of life at birth 
resulting from the changes in mortality conditions in two or three age 
groups as the case may be. 


Operative effect in terms of main effect and interactions 


Starting from definition, the “Operative effect” over each of the 
three age groups can be worked out. If 0,, O. and O, denote respec- 
tively the operative effects over the age groups 0 to z, z to r+ n and 
z+ n to w years, it can be shown that 

O, = (1/1'o) (Uo/lo) [lo — — le — ex) 
0. = (1/19) (V'./lz) (e's er) loan Cxsn) | (12) 
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Comparing the formulae (10), (11) and (12), it is seen that 
O, =M, + + Tis + 
= Ms + + Tos + Ties (13) 
Os = Mz + Ths + Tos + 


Again it is noticed that the operative effect of an age group is equal 
to the sum of the main effect of the age group and all the interactions 
in which that age group plays a part. 


DISCUSSION 


When the age span is divided into a number of age groups, the dif- 
ference in the expectation of life at birth at any two periods is equal to 
the sum of the main effects over the different age groups plus all the 
interactions between these age groups. The interactions, resulting as 
they do from the change in mortality conditions in two or more age 
groups, are not wholly attributable to any single age group. In con- 
sidering therefore the main effect as the contribution of the change in 
mortality conditions of an age group on the expectation of life at birth, 
the part that this age group contributes toward interaction is ignored. 
On the contrary if the “operative effect” is considered as the contri- 
bution of the age group, that age group is given the onus of all the 
interactions toward whose being that age group is only partly responsible. 
The absence of a logical basis for apportioning the interaction between 
the different age groups is the main difficulty in working out the con- 
tribution of the different age groups to the change in the expectation of 
life at birth. 

One method of getting over this difficulty is to evaluate both the 
main effect and operative effect and consider these as the two limits 
within which the value of the contribution lies. Another is to formulate 
some arbitrary procedure by which the interaction could be assigned to 
one or other of the age groups responsible for producing it. For instance 
it may be decided to assign an interaction to the oldest age group 
involved in its production. Alternatively it may also be decided to assign 
an interaction to the youngest age group concerned. If the contributions 
of the different age groups worked out on these two assumptions may 
for brevity be called “ Effect-interaction deferred”? and “ Effect- 


*This procedure was used by the author in “Some aspects of Parsi dem- 
ography,” Human Biology, Vol. 20, p. 77, 1949. 
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interaction forwarded” respectively, it will be observed that the sum 
of the “effects” over all the age groups obtained by either method will 
exactly account for the difference in the expectation of life at birth in 
the two periods. These methods of evaluating the effect have also the 
advantage, which the concepts of “ main effect ” and “operative effect ” 
do net possess, that the effect over two or more adjoining age groups is 
easily obtained by adding the effects calculated over each of the age 
groups. The nature of the formulae for obtaining the two effects—with 
interactions deferred and forwarded—can be seen by working these out 
for the case considered previously, viz., of the age span divided into 
three groups. These are as follows: 


Effect-interaction deferred 
Effect of age group 0 to rv = 
M, = (1/10) — —Ve(e’s — ez) ] 
Effect of age group tor -+n = (14) 
+ Ihe = (1/10) (e's — ee) —V ein — Caen) | 


Effect of age group r+ n tow = 
Ms t+ Lis + Les + lies = (1/l’o) — Cx) | 


Effect-interaction forwarded 


Effect of age group 0 to z = 
hea = 
(1/lo) [lo(e’o — ¢0) —le(e’e — 
Effect of age group x tor-+n = (15) 
Mz + = (1/lo) [Ie — ex) — — Caen) 


Effect of age group z-+-n to w = 
MM, = (1/1,) [len — Cxsn) J, 


In fact the effect for age group x to r+ n given above can be used 
more generally to calculate the effect of any age group, irrespective of 
the number of groups into which the age span is divided. 

It does not appear possible to advocate any one procedure of allo- 
cating the interaction as superior from a theoretical point of view, and 
the method of choice in any particular case may therefore have to rest 


& 
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en the practical issues involved. An appreciation of the precise nature 
of the difficulties, as set forth above, that arise in evaluating the effect 
should undoubtedly assist in the choice of the method to be used in any 
particular instance. 


Illustrations.* The formulae discussed in the foregoing text are applied 
below to the data provided by the life tables for males in Sweden in the 
two periods 1901-1910 and 1936-1940. Table 1 shows the number of 
gurvivors and the expectation of life at different ages as given by the 
two life tables. 

TABLE 1 


Number of survivors and expectation of life 
at different ages in Swedish life tables for males 1901-10 


and 1936-40 
1901-1910* 1936-1940** 
Number of Expectation Number of Expectation 
AGE survivors of life survivors of life 
0 100 000 54.53 100 000 64.30 
1 90 745 59.06 95 300 66.46 
5 86 491 57.90 94 038 63.33 
10 84 762 54.03 93 365 58.77 
20 81 638 45.88 91 760 49.70 
30 76 619 38.57 88 923 41.13 
40 71 897 30.77 85 958 32.37 
50 65 702 23.17 81 123 23.97 
60 56 548 16.06 71 870 16.35 
70 41 680 9.85 54 111 9.92 


*From United States Life Tables (pp. 208-209, 216-217), prepared by James 
W. Glover. Government Printing Office (Washington), 1921. 
** From Statistik Arsbok for Sverige (p. 66), 1945. 


Age span divided into three age groups. Dividing the age span into the 
three age groups 0-1, 1-5 and 5 years and over, a straightforward appli- 
cation of formulae given in (10) and (11) yields: 


M=; [100,000 (64.30-54.53) — 95,300 (66.46-59.06) ] 
2.72 
M, — —1 _ 300(66.46-59.06) — 94,038 (66.33-57.90) ] 
100,000 95,300 
= 1.85 


‘I am grateful to Marianne Knopf of the Population Division, United Nations, 
for carrying out the calculations in this section. 
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and similarly: 


4.70 
= 4.66 
Mes 6.72 
1 
M,; = 700,000 £200,000 ( 64.30-54.53) — 95,300 (66.46-59.06) 
95,300 
+0745 X 86,491 (63.33-57.90) ] = 7.65 
9.77 
1 (100,000 90,745 ea 
100,000\ 100,000 35:30 >) [95,300 (66.46-59.06) — 94,038 (63.33-57.90) 
= 0.09 
Tes 0.17 
1 95,300 
700,000 86,491 1) (68.83-57.90) = 0.23 
1 86,491 94,038 
700,000 (90705 — 95,300) ( 55705 ~ 35.50 =) (63.33-57.90) — 0.008 


Application of the formulae given in equation (12) leads to 


1 100,000 
O.= 100,000 100,000 [100,000 (64.30-54.53) — 90,745 (66.46-59.06) ] 
= 3.05 
Similarly : 
0, 2.12 
Os; 5.11. 


From the numerical values given above it is seen that 
M, + Thre + Tis + Lies = 2.72 + 0.09 + 0.23 + 0.008 = 3.05 = 0,, 
Me + Tyo + Tos + Lies = 1.85 + 0.09 + 0.17 + 0.008 = 2.12 = 02, 
Mz + Tis + Tog + Ties = 4.70 + 0.23 4+ 0.17 + 0.008 = 5.11 = Os, 


verifying the formulae given in equation (12). 


57.90) 
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Age span divided into a large number of groups. The formulae for the 
calculation of the “main effect,” “operative effect,” “effect-interaction 
deferred” and “ effect-interaction forwarded” for any age group z to 
2+ mn years as given in the text are as follows: 


Main effect (1/l,) x) Van (Cen Cm) | 
Operative effect = (UV2/le) [le(e’e — ex) — — Caan) | 


Effect-interaction = (1/I’,) — er) —Van(Ccm— Cen) | 
deferred 


Effect-interaction =: ( 1/1,) ( ex) loon — Cxsn) 
forwarded 


Application of these formulae to the data given in Table 1, in which 
the age span is divided into ten age-groups, leads to the results given in 
Table 2 below. 


TABLE 2 


The various “ effects” 


EFFECT- EFFECT- 

AGE GROUP OPERATIVE INTERACTION INTERACTION 

IN YEARS MAIN EFFECT EFFECT DEFERRED FORWARDED 
0-1 2.72 3.05 2.72 3.05 
1-5 1.85 2.12 1.95 2.02 
5-10 0.63 0.74 0.68 0.68 
10-20 0.84 0.99 0.92 0.90 
20-30 1.09 1.30 1.23 1.16 
30-40 0.78 0.94 0.90 0.81 
40-50 0.61 0.75 0.73 0.62 
50-60 0.36 0.45 0.44 0.36 
60-70 0.13 0.17 0.17 0.13 
70- 0.03 0.04 0.04 0.03 
Total 9.04 10.55 9.78 9.76 


The effects with interaction deferred or forwarded when summed 
over all the age groups equal the difference of the expectation of life at 
birth in the two periods, viz. 9.77, as they should. The sum of the 
“main effects” equals 9.04, the difference between this figure and 9.77, 
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viz. 0.73, being equal to the sum of the “interactions.” As noted in the 
text the real difficulty is the lack of a logical basis for apportioning this 
interaction between the various age groups. The sum of the “ operative 
effects ” exceeds 9.77 by practically the same amount by which the sum 
of “ main effects ” is in defect. This feature is not algebraically correct 
but in practice will hold good due to the fact that the second and higher 
order interactions will in general be of negligible magnitude. 


A BLOOD PRESSURE STUDY OF THE NATIVES OF 
PONAPE ISLAND, EASTERN CAROLINES 


BY RUPERT I. MURRILL * 


N the summer of 1947, while making an anthropometric survey of 

the natives of Ponape in the Eastern Carolines, I had the oppor- 
tunity at the same time of taking their blood pressures. 

Ponape is a high basalt island approximately 900 miles southeast of 
Guam. The climate shows an annual average temperature of 80° F, 
humidity 86 per cent, and rain-fall around 180 inches — in short, a 
tropical island. Ponape is about 130-145 square miles in size, with 
mountains in the interior rising to 2500 feet. Between the coast line 
and the foot of the mountains the land is mostly flat, and it is here that 
the natives live. It is divided into 5 Districts,—Sokas, Net, U, Mato- 
lenim, and Kitti. Since the main town of Colonia was destroyed by 
incendiary bombs and has not been rebuilt, one can say that all the 
natives are essentially “ rural.” 


SAMPLE 


I particularly want to stress the nature of the sample. The natives 
may be conveniently divided into two main types: (1) “Pure” Pona- 
peans—that is to say, those whose ancestry shows no mixture with whites ; 
and (2) Mixed. These can be subdivided into: (a) Ponapean natives 
who mixed with whites, such as Americans, English, French, Germans, 
and Portuguese; (b) Ponapean natives who mixed with out-islanders, 
natives from surrounding islands; (c) Ponapean natives who mixed with 
the Japanese. The present sample is concerned entirely with type (1). 
It is therefore representative of type (1) and not the total population of 
the island. 

Actually one wonders whether the physiological phenomenon of blood 
pressure is any different in the above two types, as they are all living in 
the same environment. 


* Research Fellow, University of Puerto Rico. 
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Since the natives live in separate farmsteads, and one has to walk 
to get around, distances are too great to visit each house individually. 
The local District Police Chief was therefore instructed to summon the 
men and women to the District meeting house, from about every third 
or fourth home. Great stress was laid on the fact that they were not to 
be from the same family, all this being carefully checked in the subse- 
quent interview. This was done in each of the five Districts, so one can 
say that this was a random sample. Furthermore each one of the natives 
used was normal and healthy; that is to say, none of them were hospital 
patients nor was a single blood pressure reading taken in a hospital. 

Blood pressure readings were taken on 127 men aged 20-59, and 124 
women aged 18-59. This is approximately one-eighth of the “ Pure” 
Ponapean population between the same ages. 


METHOD 


Before each subject was measured, he or she sat at a table being 
interviewed in regard to age and genealogy, for at least 15 minutes. 
They were put at ease as much as possible. At the end of this time the 
blood pressure was taken, The subject’s arm rested on the table at about 
heart level. One reading was taken by the auscultatory method, always 
Ly myself, and always on the right arm, using a Tycos aneroid sphygmo- 
manometer with a 12cm. arm band. The systolic reading was taken at 
the appearance of the first sound and the diastolic at the change in tone. 


RESULTS 


In spite of the fact that it is claimed in recent papers (1) that blood 
pressure increases with age, especially after the age of 40, I have fol- 
lowed the example of Robinson and Brucer (2) and removed from the 
main sample those blood pressures of 140 systolic and over, and 90 
diastolic or over. These pressures are provisionally designated as hyper- 
tensive — “abnormal,” if you will. The remainder are called “ normal ” 
and the results are summarized in Tables 1 and 2. The complete data 
for all individuals are given in the Appendix Tables 1 A and 1B. 

By this method 10 males, or 7.9 per cent of the total male sample, 
and 14 females, or 11.3 per cent of the total female sample, have been 
excluded. Extremely low systolic pressures have not been discarded since 
none of the males and only 0.8 per cent of the females in the total group 
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had such pressures below 90 mm.; 92.1 per cent of all the males and 
88.7 per cent of all the females had diastolic pressures below 90 mm. 


TABLE 1 


“Normal” systolic and diastolic blood pressures by age—males 
(delimited group) 


mm. Hg 20-24 25-29 30-34 35-39 40-44 45-49 50-54 55-59 AGES 


Systolic pressure 


90-99 1 4 2 1 2 10 
100-109 5 5 11 3 6 4 3 3 40 
110-119 5 13 9 4 4 6 4 3 48 
120-129 1 2 3 2 3 2 2 2 17 
130-139 2 2 
Total 11 21 23 9 17 16 10 10 117 
Means 110.4 111.6 110.5 112.9 107.5 112.7 111.0 109.0 110.7 

Total group 
Means 110.4 112.2 112.8 1150 109.8 112.7 112.3 1095 111.9 
Diastolic pressure 

50-59 2 1 1 4 

60-69 2 1 1 5 2 2 18 

70-79 4 14 11 4 8 7 8 4 60 

80-89 3 6 7 3 4 7 2 3 35 
Total ll 21 23 9 17 16 10 10 117 
Means 71.3 764 749 740 734 77.1 79.8 73.0 74.8 

Total group 
Means 7130 77.2 77.1 77.0 75.6 77.1 79.8 749 76.4 


Here and elsewhere groups have been centered at 94, 104, etc., for the calculation 
of means. 


In the delimited group (Table 1), for 117 males the mean systolic 
pressure is 110.7 mm. and the standard deviation 7.8 mm. Therefore two- 
thirds of the men have a systolic pressure between 102.9 and 118.5 mm. 
The mean diastolic pressure is 74.8mm. with a standard deviation of 
5.8 mm., giving a range of 69.0 to 80.6 mm. 

For 110 females in the delimited group (Table 2), the mean systolic 
pressure is 108.6 mm. with a standard deviation of 7.4 mm. and a range 
of 101.2 to 116.0mm. The mean diastolic pressure is 74.1 mm., with a 
standard deviation of 5.1 mm., thus giving a range of 69.0 to 79.2 mm. 
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In the delimited group 83.7 per cent of the males and 87.3 per cent of 
the females have a systolic pressure below 120 mm. 


TABLE 2 


“ Normal” systolic and diastolic blood pressures by age—females ) 
(delimited group) 


mm. Hg 15-19 20-24 25-29 30-34 35-39 40-44 45-49 50-59 aGES 


Systolic pressure 


80-89 1 1 
90-99 1 3 3 2 1 10 
100-109 2 9 10 9 7 5 4 4 50 
110-119 1 7 8 6 5 5 3 35 
120-129 1 1 2 3 3 2 2 14 
Total 5 10 23 20 16 15 ll 10 110 
Means 108.0 106.0 106.6 1065 111.5 110.0 112.2 110.0 108.6 ) 
Total group 
Means 108.0 107.6 107.3 107.3 111.7 110.9 117.1 119.0 111.0 


Diastolic pressure 


50-59 1 1 2 
60-69 3 6 5 3 4 1 22 
70-79 5 5 9 14 9 8 4 5 59 
80-89 2 7 1 3 3 6 5 27 
Total 5 10 23 20 16 15 11 10 110 
Means 74.0 730 736 72.0 72.7 73.3 78.5 79.0 74.1 
Total group 
Means 74.0 749 744 73.0 740 746 85.3 83.5 76.6 


For those who will have none of these delimited groups, Table 3 has 
been added. In this table none of the pressures are excluded, yet the 
mean systolic pressure for males is 111.9mm., with a mean diastolic 
pressure of %76.4mm. In the females the mean systolic pressure is 
111.0 mm., and the mean diastolic 76.6mm. There is little difference 
then between this group and the delimited group. 

The effect of age on blood pressure in the delimited group is shown 
in Fig. 1. 


| 
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TABLE 3 


Systolic and diastolic blood pressures of total group by sew 


SYSTOLIC PRESSURE DIASTOLIC PRESSURE 
mm. Males Females mm. Males Females 
80-89 = 1 50-59 4 2 
90-99 10 10 60-69 18 22 
100-109 40 50 70-79 60 59 
110-119 50 37 80-89 35 27 
) 120-129 22 21 90-99 8 ll 
130-139 4 2 100-109 2 3 
140-149 l 2 
150-159 
160-169 1 
Total 127 124 Total 127 124 
Mean 111.9 111.0 Mean 76.4 76.6 
% under 100 7.9 8.9 % under 60 3.1 1.6 
% under 110 39.4 49.2 % under 70 17.3 19.4 


% under 120 78.7 79.0 % under 80 64.6 66.9 
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This graph indicates that there are differences in the pressures of males 
and females in this sample. Up to 40 years of age, the females have 
lower systolic and, on the whole, lower diastolic pressures than the males. 


zo 30 40° 5° 
Age 


Fic. 1. Brioop PRESSURE AND AGE, BY SEX, DELIMITED GROUP. 
Upper PANEL, SysToLic; Lower PANEL, DIASTOLIC 


After the age of 40, the systolic pressures of the males and females are 
similar while the diastolic pressures are somewhat higher in the females. 
Table 4 shows that more males over 40 years of age have systolic 
pressures under 100 and 110 mm., while the reverse is true in the females. 


@ 
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TABLE 4 


Systolic blood pressure in males and females 
(delimited group) 


SysToLic 

PRESSURE MALES FEMALES 
(mm. Hg) Under 40 Over 40 Under 40 Over 40 
Under 100 1.6% 17.0% 10.8% 8.3% 
Under 110 39.1 47.2 60.8 44.4 
Under 120 87.5 79.2 90.5 80.6 
Over 120 12.5 20.8 9.5 19.4 


Table 5, which includes all pressures in those over 40 years of age, 
shows that as far as the mean systolic pressure is concerned, in the males 
it increases up to 50 years of age then decreases. In the females it 
increases with age throughout the age groups. The diastolic pressure 


TABLE 5 


Systolic and diastolic blood pressures by sex and age, 
of those 40 years of age and over (total group) 


MALE FEMALE 
Age No. Mean Age No. Mean 
Systolic 
40-44 19 110.3 40-44 16 111.4 
45-49 16 113.2 45-49 16 117.6 
50-54 12 112.8 50-59 14 119.5 
55-59 11 110.0 
Diastolic 
40-44 19 76.1 40-44 16 75.1 
45-49 16 77.6 45-49 16 85.8 
50-54 12 80.3 50-59 14 83.8 
55-59 ll 75.4 


in the males increases up to 55 years of age, then decreases; in the 
females it increases up to 50 years of age, then decreases. Therefore in 
this sample, except for the mean systolic pressure in the females 
(Table 5), and the female mean diastolic pressure after the age of 30 
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in the delimited group (Fig. 1), there is ne clear-cut increase of systolic 
or diastolic pressure with age.' 

Finally it is notable that in those males and females excluded from 
the delimited groups, the majority were excluded because they had a 
high diastolic pressure rather than a high systolic pressure. This seems 
to agree with Huber (3) and Russek (1) that the diastolic level is more 
indicative of hypertension. 


DISCUSSION 


This paper is concerned not with hypertension but rather with so-called 
hypotension. Several authors (4) have indicated that blood pressure in 
the tropics is “low” compared to American “normal” pressure. These 
“low” systolic pressures found in the tropics range anywhere from 100 
to 125mm. for males or females. If, however, we use Robinson and 
Brucer’s “normal” range (at least for those up to 40 years of age) of 
100-125 mm, systolic for males or females, even though their sample is 
by no means representative of the population of the United States, where, 
then, is the “low” pressure ascribed to the tropics? Why any need to 
introduce such explanatory factors as race, diet, climate, and so on? 

However, as can be seen in this sample, 42.7 per cent of the males 
and 55.5 per cent of the females in the delimited group have systolic 
pressures under 110 mm., and it may be argued that regardless of the 
“normal” range, this is a high proportion of “low” pressures. 

It is admitted here that this study has certain limitations. First, 
only one blood pressure reading was taken per person. Second, it is 
estimated that 100 per cent of the Ponape population is infested with 
hookworms, in addition to which a large proportion are suffering from 
tuberculosis (malaria is not present on Ponape). In regard to this second 
point, one might say, therefore, that this sample is neither “ normal ” 
nor “healthy.” One immediately wonders what effect this has on the 


1 (Nore. It has seemed of some interest to examine the statistical significance 
of the changes of blood pressure with age. Analysis of variance, using the total 
group, gives results summarized below. 

For the males, there is no evidence of any significant variation with age in 
either systolic or diastolic pressure. 

For the females there are significant changes with age in both systolic and 
diastolic pressure. The nature of these changes consists in an increase in both 
systolic and diastolic pressure at ages 45 and over. These changes are not 
apparent in the delimited group. Actually, 9 of the excluded cases occur in the 
two highest age groups.—C. P. W.] 
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blood pressure. It is possible that this might explain the proportion of 
the sample with pressures below 110 mm. systolic. 

Donnison (4) reports mean systolic pressures in male Negroes in 
Kenya, East Africa of 123.1 mm. at 15-19 years of age, increasing to 
126.1 mm. at 30-34 and thereafter decreasing to 105.8 mm. at 60 years 
of age and over. Here we have not only blood pressure decreasing with 
age, but also an area with a high incidence of schistosomiasis. One 
wonders again what could be the effect of such infestation on blood 
pressure. Saunders (4) reports 80 per cent infestation of the population 
with ascariasis in Yucatan. The time has come to cease wondering. 
A study on blood pressure should be done, in an area having intestinal 
parasites, using one group that is known to be free of the parasites as 
control, and another group that does have them. 

It is claimed that when foreigners migrate to tropical countries their 
blood pressure drops considerably. Leaving aside their new level of blood 
pressure and its comparison with American “norms,” one can find a 
simpler explanation for this lowering of blood pressure, naive as it may 
sound. Most foreigners in tropical or sub-tropical countries live well 
compared to their former life; they usually have servants, they hurry 
less,—in short, they slow down. This lessened tension may well lower 
the blood pressure. 

It is interesting to observe that several authors (5) claim a high 
incidence of hypertension among Negroes both in the United States and 
the tropics, contrary to Donnison’s results. In each case we have an area 
where the Negro is in close contact with white civilization. He may be 
living economically and emotionally on an inferior plane to the whites 
and this may well affect his blood pressure. Saunders (5) states, 
“A greater percentage of Negroes in the Virgin Islands have a systolic 
pressure of more than 150 mm., and of less than 110 mm., than residents 
of the United States.” He seems to have two groups within the Negro 
population. It would be worth knowing which Negroes (urban or rural, 
etc.) in his sample had the high pressures. 

In conclusion, and this is a main point of this paper, it should be 
evident by now that in all the voluminous literature on blood pressure, 
not one sample exists that is truly representative of the normal healthy 
population of the United States. And yet one finds published samples, 
half of which contain hospital patients, or samples almost wholly con- 
sisting of urban dwellers, or insurance company samples, etc., being 
passed off as “ representative” of the population of the United States— 
not to mention the rather dogmatic conclusions made from such samples 
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concerning blood pressure. Mere numbers prove nothing. It must be 
obvious that blood pressures of a large number of Belgian Congo 
pygmies are not representative of blood pressures of all African Negroes, 
yet this is, in essence, the technique used in the medical literature. 
The medical profession is greatly concerned with diseases of the 
heart and its concomitant »-sults. We now have a phrase for it, “ The 
No. 1 Killer.” Surely it is high time that blood pressures be taken on a 
sample that is representative of the population of the United States (in 
regard to sex, age, occupation, urban or rural residence, diet, and so on), 
and settle once and for all what is “normal” blood pressure, and 
whether or not blood pressure does increase with age. Such an under- 
taking will be expensive and time-consuming but certainly worthwhile. 


SUMMARY 


1. A random representative sample of “ Pure” Ponapeans has been 
used in this study. 

2. The mean systolic blood pressure for 127 males, ranging in years 
from 20 to 59, was found to be 111.9 mm., the diastolic pressure 76.4 mm. 
For 124 females, ranging in age from 18 to 59 years, the mean systolic 
pressure was 111.0 mm., the diastolic 76.6 mm. 

3. In a delimited group (excluding pressures of 140 mm. systolic 
or over and 90mm. diastolic or over) the mean systolic pressure for 
117 males was 110.7 mm., the diastolic 74.8mm. For 110 females, the 
mean systolic pressure was 108.6 mm., the diastolic 74.1 mm. 

4. Approximately 80 per cent in the total group, and over 80 per 
cent in the delimited group, of males and females, had systolic pressures 
below 120 mm. 

5. Depending on what range one uses for “ normal ”. pressure, it is 
doubted if tropical hypotension exists. 

6. It is hoped that truly “representative” samples will be gathered 
in the future. 
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TABLE 1A 
Age and blood pressures (in mm.) of 127 male natives of Ponape Island 
(Individuals marked * were excluded from the delimited group treated in the text.) 
AGE SYSTOLIC DIASTOLIC AGE SYSTOLIC DIASTOLIC 
20 100 se 38 122 70 
50 39 104 82 
118 78 106 70 
aed vad 40 92 68 
21 108 72 104 68 
108 80 114 78 
114 82 
22 110 62 
110 70 41 108 78 
24 104 68 
108 80 42 $e 70 
10 
25 118 72 106 70 
2 104 78 108 70 
108 72 120 80 
110 70 *130 92 
110 78 
43 94 74 
120 76 96 68 
27 104 78 100 60 
112 78 122 86 
114 78 126 84 
114 80 us 
118 86 
45 104 74 
46 102 70 } 
28 110 78 
106 72 47 98 72 
110 78 102 74 
112 80 110 80 
122 84 118 82 
29 118 70 186 82 
118 80 48 98 es 
102 2 
110 84 116 82 
118 78 120 82 
118 80 130 70 
3 1 6 49 118 64 
4 120 80 
51 *112 90 
32 106 66 52 102 78 
114 78 
116 76 ee 8 
120 84 124 100 
53 110 78 
108 70 120 do 
54 96 70 
“260 ve 55 104 68 
34 104 74 116 84 i 
106 76 122 82 
108 68 
* 56 100 76 
122 92 one 
35 110 76 
120 82 57 104 r= 
11 
37 104 68 
110 78 58 96 58 
110 88 98 70 
114 58 110 70 


#132 100 124 78 
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TABLE 1B 
Age and blood pressures of 124 female natives of Ponape Island 
(Individuals marked * were excluded from the delimited group treated in the text.) 
.) AGE SYSTOLIC DIASTOLIC AGE SYSTOLIC DIASTOLIC 
18 98 72 104 76 
106 72 110 74 
118 78 120 78 
124 78 108 "6 
19 102 70 114 $4 
1 
20 104 78 
124 88 
21 100 70 
“124 90 120 80 
22 102 68 38 100 62 
= = 110 76 
23 104 74 
73 124 82 
24 100 64 ad 4 = 4 
) 110 82 
100 70 
110 120 73 
114 
122 84 
118 80 42 100 72 
122 80 108 72 
338 ad 43 98 66 
26 108 84 100 62 
27 98 60 
i 100 72 190 
i 104 60 44 1 78 
*122 92 #122 90 
28 100 76 45 100 70 
104 62 102 70 
104 76 1 
106 68 *138 102 
0 
46 108 68 
110 76 = 
29 90 64 *120 100 
108 124 16 
0 
47 *120 96 
30 102 64 124 88 
104 76 “144 102 
108 72 
108 72 48 110 78 
108 74 110 80 
108 78 114 84 
49 *116 92 
64 118 80 
122 98 50 98 Hy 
31 98 64 1 
102 118 84 
128 88 
32 110 70 *130 90 
110 72 *160 90 
112 78 
118 76 51 106 74 
33 98 72 52 102 72 
; 100 68 110 72 
104 78 80 
34 94 76 
110 78 53 106 16 
35 102 58. 56 124 82 


NOTES 


REPORT ON A SERIES OF ILLEGAL ABORTIONS 
INDUCED BY PHYSICIANS * 


EVERAL investigators (1, 2, 4, 5, 7) have presented evidence to 
S show that at least in urban areas of the United States the great 
majority of illegal abortions are induced by physicians. These cases are 
rarely admitted to hospitals for completion or for the treatment of com- 
plications, and they do not often appear in studies of mortality. Little 
is known about them except that they are very numerous. 

Through good fortune the author has come into possession of a series 
of 363 records representing the practice of two such abortion specialists 
in a large Eastern city during several months in 1948. Thanks are due 
to the individuals who have made this material accessible for research. 
The reader must be satisfied with the author’s assurance that the records 
are genuine, complete, and probably as good as those kept by most prac- 
titioners and clinics. However, the material does not lend itself to a 
study of the course of recovery or of sequelae. 

All but one of these abortions were performed between the 5th and 
13th weeks of pregnancy, counting from the estimated date of conception. 
The average period of gestation was 8.5 weeks. One pregnancy was 
interrupted in the 15th week. It is not known why this particular patient 
was accepted at that advanced stage. 

The records do not contain usable information concerning the occu- 
pational, social, or economic background of the clientele. It is known, 
however, that the fees charged varied from $300 to $500, which should 
indicate a fairly high level of income. Of the 363 women, 102 were single, 
180 (49.6 + 2.6 per cent) married, and 81 previously married. About 
half of the latter group were widows, the others divorced. The percentage 
of married women was lower than, but not significantly different from 
that reported by Hamilton (3) in New York, and much lower than 


* Read at the annual meeting of the American Population Association, Prince- 
ton, N. J., May 28, 1949. 
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among the cases studied by Simons (6) in Minneapolis, who found three- 
fourths of the induced cases in the married group. Since his were hos- 
pital patients their abortions had been induced either by the pregnant 
woman herself or by a midwife or other non-medical abortionist. Many 
were probably drawn from the underprivileged group where economic 
pressure on the married woman is comparatively greater, and social 
pressure on the unmarried woman perhaps less, than in the class from 
which the present series is recruited. Another factor contributing to the 
difference may be a greater willingness on the part of married women to 
seek admission to a hospital for the treatment of abortion, whereas the 
unmarried will tend to avoid hospitalization unless it is clearly necessary 
because of fever or other complications. 


TABLE 1 


Women undergoing illegal abortion by marital status, age, number of children 
ever born, and previous induced abortions 


PREVIOUSLY 
SINGLE MARRIED “MARRIED TOTAL 
Age (years) 
10-14 3 3 
15-19 22 10 2 34 
20-24 29 44 15 88 
25-29 21 42 28 91 
30-34 18 42 20 80 
35-39 6 19 10 35 :. 
40 and over 3 23 6 32 
Children born 
0 100 45 25 170 
1 2 39 31 72 
2 - 52 16 68 
3 - 27 8 35 
4 and over - 17 1 18 
Previous abortions 
0 87 147 64 298 
1 10 18 15 43 
2 2 10 2 14 
3 and over 3 5 - 8 


Total 102 180 81 363 
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The women in the present series ranged in age from 13 to 47 years 
(Table 1). The average age was 28.6 years. As one would expect, the 
single women were youngest; while for the married and the previously 
married, the average age was practically the same. 

Of the group as a whole, 170 or almost half had never borne a child 
(Table 1). The childless included all but two of the single women, 
one-fourth of the married, and one-third of the previously married. The 
total number of children born was 397 for the whole group, including 
303 reported by the married women. The average number of children 
ever born was 1.09 for the group as a whole and 1.68 for the married. 

It is of interest to compare the married women in this series with a 
group of women delivered on the private service of a large hospital in 
the same city in 1948. Table 2 presents a comparison in terms of chil- 
dren born before the current abortion or delivery. The differences are 


TABLE 2 


Comparison of 180 married women undergoing illegal abortion 
and 481 women delivered on a private service in 1948 


PREVIOUS NUMBER OF CASES PERCENTAGE DISTRIBUTION RATIOOF 
CHILDREN Abortions Deliveries Abortions Deliveries PERCENTAGES 
0 45 206 25.0 42.8 3:5 
1 39 164 21.7 34.1 2:3 
2 52 86 28.9 17.9 56:3 
3 27 21 15.0 4.4 3:1 
4 and over 17 4 9.4 8 ll: 1 
Total 180 481 100.0 100.0 - 


striking. They confirm earlier findings (1, 4, 8, 9) that the incidence 
of illegal induced abortion tends to increase with parity, and suggest 
that in this group abortion was used primarily not as a method of child- 
spacing but of limiting the ultimate size of the family. This was proba- 
bly not true for the ten married women, 15-19 years old, in the abortion 
series. There was only one case in this age group among the 481 
deliveries. This seems to indicate that illegal abortions are also resorted 
to by those who are not yet ready to shoulder the responsibilities of 
raising a family. 

In addition to their 397 children, the women in this series reported 
29 unintentional abortions. This number represents seven per cent of all 
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| 

Ts pregnancies terminating without interference. This is a plausible ratio | 

he which is only slightly lower than one would expect on the basis of earlier | 
ly studies (5,10). It adds to the general credibility of the records. a 
Sixty-five women, or 17.9 per cent of the group, admitted one or iH 

ld more induced abortions preceding the current one (Table 1). The pro- i} 
n, portion was not significantly different for the single, the married, and i 
he the previously married. This information is probably more complete i. 
1g than it is likely to be in a series of different origin because there was | : 
on apparently less reason for dissimulation. The total number of previous a 
d. induced abortions was 101, representing one-fifth of all previous preg- q 
a nancies. Many of them had been performed by the same operators as the i 
in current one. i 
il- If the proposition is accepted that first and later induced abortions F 
re had an equal chance of being represented in our sample, then the average 


number of induced abortions in the population from which this sample i 
is drawn can be estimated to be on the order of 1.2 (363/298) per woman. 
This figure, of course, refers only to those women who had at least one 
induced abortion during their reproductive lives. Since many women 
i never resort to illegal abortion, the average number for all women must : 
have been much lower, but it cannot be computed from this series of 
records. 

As far as the author is aware, this is the first series of illegal abor- 
tions induced by physicians ever reported on in American medical 
literature. The number of cases is not large and it cannot be estimated 
how far the findings are typical of the activities of abortion specialists q 
around the country. Much work remains to be done until we shall have q 


= 


adequate knowledge of this much neglected field of human behavior. i 
q 
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